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ABSTRACT 


The first reported case of Middle East respiratory syndrome-coronavirus (MERS-CoV) 
infection was identified in Saudi Arabia in September 2012, since which time there have 
been over 2,000 laboratory-confirmed cases, including 750 deaths in 27 countries. Nucleic 
acid testing (NAT) is the preferred method for the detection of MERS-CoV. A single round 
of a Proficiency Testing Program (PTP) was used to assess the capability of laboratories 
globally to accurately detect the presence of MERS-CoV using NAT. A panel of eleven 
lyophilized specimens containing different viral loads of MERS-CoV, common 
coronaviruses, and in vitro RNA transcripts was distributed to laboratories in all six WHO 
Regions. A total of 96 laboratories from 79 countries participating in the PTP, with 76/96 
(79.2%) reporting correct MERS-CoV results for all nine scored specimens. A further 10 
laboratories (10.4%) scored correctly in 8/9 specimens of the PTP. The majority of 
laboratories demonstrated satisfactory performance in detecting presence of MERS-CoV 
using NAT. However, some laboratories require improved assay sensitivity, reduced cross 
contamination of samples, and improved speciation of coronavirus subtypes for potentially 
complex clinical specimens. Further PTP, and enhanced links with expert laboratories 
globally may improve the laboratory performance. 
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INTRODUCTION 


Middle East respiratory syndrome (MERS) is a viral respiratory disease first identified in 
Saudi Arabia in 2012 with cases continuing to be detected in the Middle East. Cases detected 
elsewhere have either been infected in the Middle East or been part of a chain of 
transmission originating in the Middle East. The disease is due to infection with the Middle 
East respiratory syndrome coronavirus (MERS-CoV), previously known as Novel 
coronavirus 2012 or HCoV-EMC |”. Human infection is thought to follow exposure to 
infected camels or human-to-human transmission primarily in healthcare settings. As of 
March 2018, the World Health Organisation (WHO) had been notified of 2,143 laboratory- 
confirmed cases of infection with MERS-CoV globally, including 750 deaths °. 


Apart from epidemiologic clustering and virus-specific diagnostic testing, there is little 
clinically that distinguishes MERS-CoV infection from other severe viral respiratory 
infections such as severe acute respiratory syndrome (SARS) or influenza. Nucleic acid 
testing (NAT) is the preferred method for detecting MERS-CoV. Suitable specimens for 
testing include lower respiratory tract samples (LRT), nasopharyngeal swabs, oropharyngeal 
swabs, nasal washes, and nasal aspirates. The LRT samples have been shown to contain the 
highest viral loads, possibly due to virus tropism for LRT cells *°. Confirmation using real 
time reverse transcription-polymerase chain reaction (RT-PCR) assays require a positive 
result for at least two different specific targets on the MERS-CoV genome using a validated 
assay, or a positive rRT-PCR result for one specific target on the MERS-CoV genome plus 
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MERS-CoV sequence confirmation from a separate viral genomic target °. Nucleic acid 
sequencing of an amplicon has also been recommended when there are discordant results on 
different assays °’, confirming the specificity of the target. 


It is important that laboratories develop technical capability to accurately and promptly 
identify MERS-CoV in order to implement appropriate infection control and isolation 
procedures to reduce the potential for transmission, and aid a rapid epidemiological 
investigation. External quality assessment programs are an essential tool for monitoring the 
diagnostic proficiency of laboratories and providing results that allow implementation of 
improved testing, thereby strengthening global capability in reducing spread. The World 
Health Organization (WHO) initiated a single round Proficiency Testing Program (PTP) for 
the detection of MERS-CoV by PCR, which was conducted in the first half of 2015 by the 
Royal College of Pathologists of Australasia Quality Assurance Programs (RCPAQAP). 


METHODS 
Participation 


The WHO identified 133 laboratories from 98 countries in all six WHO regions as potential 
participants. 102 laboratories confirmed their interest and 99 subsequently confirmed their 
ability to receive the panel. A total of 96 laboratories located in 79 different countries 
returned results and participated in the PTP (Table 1). The additional verification step was 
introduced to ensure laboratories had all the documentation and permits in place that were 
required to import the material into their country. 


Panel description 


The proficiency testing (PT) panel consisted of 11 specimens. This was made up of nine 
specimens (A-I) of inactivated (gamma irradiation; 50 kGy) MERS-CoV, human 
coronavirus OC43, human coronavirus 229E, and a negative control (Specimen I), as well as 
two synthetic specimens (J & K) containing in vitro RNA transcripts. RCPAQAP have used 
similar transcripts in previous PT-panels, and have shown that they are safe, stable, and 
reliable *. The design of these transcripts was based on the complete genome sequence of 
human betacoronavirus 2c EMC/2012 (Genbank accession number: JX869059.2). The 
following five regions of the MERS-CoV genome were included in the two synthetic 
specimens: a 385-nucleotide region upstream of the E protein gene (upE) covering 
nucleotides 27,312 — 27,696; 500 nucleotides of the open reading frame 1a (ORF 1a) starting 
at nucleotide 10,923; a 502-nucleotide region of the open reading frame 1b (ORF 1b), 
starting at nucleotide 18,054, as well as two regions; one from the RNA-dependent RNA 
polymerase (RdRp) starting at nucleotide 14,994 and another from the nucleocapsid (N) 
protein gene starting at nucleotide 29,523, with a length of 392 and 491 nucleotides, 
respectively. The five RNA transcripts were designed to yield positive results in RT-PCR 
assays that were originally published by Corman et al. °’, which formed the basis of the 
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“WHO Interim guidance — Laboratory Testing for Middle East Respiratory Syndrome 
Coronavirus” ’. Specimen J contained all five RNA transcripts, whilst Specimen K contained 
a single transcript covering upE. This was designed to challenge participants with a sample 
(K) that would yield an equivocal result, as confirmatory testing to initial screening would 
return negative. 


All specimens were provided lyophilised and were tested for homogeneity and stability. 
Homogeneity was confirmed, and no significant sample degradation was detected after 
storage for seven days at 37°C and subsequent 21 days at -80°C. The MERS-CoV strain 
used was provided by Public Health England, and all coronaviruses included in the panel 
were prepared at the Victorian Infectious Diseases Reference Laboratory (VIDRL) in 
Melbourne, Australia. Following gamma irradiation of the viruses, inactivation was 
confirmed and viral RNA was quantified using real-time PCR*. The relative measure of the 
concentration of virus-specific target was determined by generating standard curves using a 
set of MERS-CoV- and HCoV-specific primers to quantify the GE copies/mL of each 
specimen®’. Three external referee laboratories confirmed sample characteristics. 


Assessment Criteria 

Participants were requested to test all specimens of the proficiency testing panel and: 
1. Rule out or confirm the presence of MERS-CoV. 

2. Rule out or confirm the presence of a HCoV other than MERS-CoV. 

3: Identify the HCoV, if present. 


Participating laboratories were assessed on their capacity to correctly analyse specimens A-I 
using their existing PCR detection protocols and reagents. This was performed qualitatively, 
with correct responses assigned on the basis of reporting the expected result e.g. MERS-CoV 
ruled out, other HCoV confirmed present and identified as human coronavirus 229E. 
Performance was assessed separately for the detection of MERS-CoV and the detection and 
identification of other HCoVs. 


Results submitted for synthetic specimens J and K were not scored, as participants were 
likely to obtain varying results depending on the gene region and PCR marker used by the 
testing laboratory. In particular, participants performing MERS-CoV specific testing 
according to the assay developed by the United States Centers for Disease Control and 
Prevention (US CDC) would expect a negative result for Specimen J, as this assay targets a 
region of the N gene that is different to the region that was used to design the in vitro RNA 
transcript included in Specimen J '°. These specimens were included as they could provide 
interesting information in regards to how participating laboratories handle equivocal test 
results. 
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RESULTS 
Capability to detect MERS-CoV and other HCoVs by PCR 


Overall, 76/96 (79.2%) laboratories correctly reported the presence or absence of MERS- 
CoV in all nine scored specimens (Figure 1). An additional 10 (10.4%) laboratories correctly 
reported the presence or absence of MERS-CoV in 8/9 scored specimens, whilst 10 (10.4%) 
had at least 2 discordant results (Table 2). The absence of MERS-CoV in the negative 
control sample (Specimen I) was correctly reported by 88/96 (91.7%) participants (Table 3). 
5 participants reported false positive results, and 3 laboratories did not report a result for this 
specimen (I) for unknown reasons. 


A large proportion of participants reported that they have no or limited capability to test for 
human coronaviruses other than MERS-CoV. In order to account for this variability, 
performance was assessed separately for the detection of MERS-CoV and the detection and 
identification of other HCoVs. There were 69/96 (71.9%) laboratories that returned results 
regarding other HCoVs, with 27 (28.1%) correctly confirming or ruling out the presence of 
other HCoVs in all nine specimens (Table 2) and 29 (30.2%) correctly identifying the two 
other HCoVs included in Specimen B (HCoV-OC43), Specimen C (HCoV-229E) and 
Specimen H (MERS-CoV & HCoV-229E). A summary of the performance of laboratories 
for all specimens is presented in Table 3. 


Limit of detection for MERS-CoV specific PCR 


The proficiency testing panel included a 10-fold dilution series (Specimens D, E, F and G), 
covering MERS-CoV RNA concentrations ranging from 4.3 x 10° Genome equivalents 
(GE)/uL to 4.3 x 10° GE/uL. There were 94/96 participants (97.9%) reporting a correct 
positive result for specimens with RNA concentrations ranging from 4.3 x 10° to 4.3 x 10! 
GE/uL and 92/96 participants (95.8%) reporting a correct positive result for all four 
specimens, including the specimen with the lowest viral load (Table 3). 


Synthetic specimens 


81/96 (84.4%) laboratories confirmed the presence of MERS-CoV in Specimen J, which 
contained all 5 in-vitro RNA transcripts. For this specimen, 7 (7.3%) laboratories ruled out 
the presence of MERS-CoV and 8 (8.3%) participants did not specify. Specimen K 
contained one in-vitro RNA transcript, for which 49/96 (51.0 %) laboratories reported the 
presence of MERS-CoV. 28 (29.2%) and 19 (19.8%) participants ruled out or did not specify 
the presence of MERS-CoV respectively (Table 3). 


Methods used for the detection of MERS-CoV 


All 96 participating laboratories tested the specimens of the proficiency testing panel for the 
presence or absence of MERS-CoV. The gene targets used by participants to confirm or rule 
out the presence of MERS-CoV in each of the 11 specimens were upE, orfla, orflb, N and 
RdRp (Table 4). 
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Participants followed various protocols to confirm or rule out the presence of MERS-CoV. 
Examination of the set of gene targets that were used showed most participants either 
followed the WHO Interim Recommendations for Laboratory Testing for MERS-CoV 
protocol ”, or the assay developed by US CDC "°. Both protocols recommend an initial 
screening assay against the gene target upE, with subsequent confirmation by one more PCR 
assays for the gene targets ORFla/ORF1b/N (WHO) or N2/N3/RdRp (US CDC). In 
accordance with these two recommendations, 93.9% of participants performed at least two 
PCR assays per specimen to confirm or rule out the presence of MERS-CoV (Figure 2). 
Taqman based real-time PCR was the most commonly used PCR method with an average of 
95.1% and 93.9% of participants using this method in the initial screening assay and the 
confirmatory second assay, respectively. Participants performing three or more PCR assays 
included conventional gel-based PCR assays as well as nested and heminested assays in their 
testing regimen. The most commonly used PCR platforms include ABI realtime PCR 
systems (42 participants), Roche LightCycler (21 participants), Bio-Rad real-time PCR 
systems (11 participants) and the Qiagen Rotor-Gene (9 participants) and Stratagene systems 
(5 participants). The majority of participating laboratories relied on manual RNA extraction 
using the Qiagen QIAamp Viral RNA Mini Kit (36 participants), followed by automated 
systems from BioMerieux (NucliSENS easyMAG) and Roche (Magna Pure System) 
employed by 15 and five participating laboratories, respectively. A range of manual RNA 
extraction systems from Qiagen, Macherey Nagel and Roche were used by seven, five and 
four participants, respectively. 


DISCUSSION 


The PTP provides insight into the diagnostic methodology and performance of laboratories 
in detecting MERS-CoV worldwide. The high level of concordance between the 96 
participating laboratories suggests a high global capacity to detect MERS-CoV. Despite this, 
a small number of laboratories performed poorly and the results of this PTP identify 
opportunities for future improvement. Incorrect results could be attributed to three main 
causes: 1) cross contamination, 11) low sensitivity of the NAT (predominantly PCR), or iii) 
transcription error. A number of laboratories reported a MERS-CoV false positive result for 
the human coronavirus samples (Specimen B & C) and the negative sample (Specimen I). 
These results were all reported with high Cy values, suggesting cross contamination of 
samples. There were four participants reporting false negative results for Specimen G, which 
contained the lowest concentration of MERS-CoV. These participants consistently reported 
unusually high Cy values for specimens across the panel, indicating that these laboratories 
had relatively low sensitivity in their PCR assay and may not have been able to detect 
MERS-CoV at lower concentrations. This finding is similar to that of two previous external 
quality assessments, which reported some laboratories to have reduced assay sensitivity 
when assessed on a 10-fold MERS-CoV dilution panel ''"'?. These studies also demonstrated 
a high overall capacity for laboratories to detect MERS-CoV in China '', and worldwide |”. 
Similarly, a study performed during the 2015 Korean outbreak reported a 100% MERS-CoV 
detection score amongst 47 participants '*. However, the panel in this study only consisted of 
three specimens, limiting their assessment of assay sensitivity. Both the Korean and Chinese 
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external quality assessments differed from this PTP in that they did not include other human 
coronaviruses for the assessment of assay specificity. Access to and participation in future 
quality assurance (QA) programs will provide the opportunity for improvement at a 
technical level. Offering an ongoing PTP for the detection of MERS-CoV and other human 
coronaviruses by PCR will ensure that this capacity will remain appropriate and provide 
continuing opportunities for improvement. 


Results for the detection and identification of other human coronaviruses were less 
conclusive, with just 28.1% and 30.2% of laboratories scoring correctly in all samples 
respectively. However these results were unsurprising, as a large proportion of participants 
reported they had no or limited capability to test for human coronaviruses other than MERS- 
CoV prior to the beginning of the PTP. The capacity to test for related organisms is 
important in distinguishing pathogens such as MERS-CoV from genetically related, but less 
virulent organisms such as other human coronaviruses. 


The two synthetic specimens containing MERS-CoV complementary DNA were included in 
the PTP as they provided non-infectious, easily accessed and scalable quantities of target 
analyte. Although these specimens were not scored, they were informative regarding how 
participating laboratories handled equivocal test results. Specimen J contained five in vitro 
transcribed RNA transcripts, a design intended to give positive results for all NAT markers 
included in PCR protocols recommended by the WHO. Specimen K contained a single 
transcript covering upE, a design that challenged participants with a sample that would yield 
an equivocal result. Participants would only get a positive result in an initial screening assay 
against upE, while confirmatory tests of this initial screen would be negative. The protocol 
recommended by the WHO advises further specimens to be collected in the absence of a 
confirmatory result. The US CDC protocol recommends reporting of an equivocal result and 
contacting the CDC for consultation. In the context of this PTP, the expected result for 
Specimen K would have been “not specified” and a comment regarding equivocal results 
and/or the necessity to collect and test a second sample. Interestingly, more than half of the 
participating laboratories reported the presence of MERS-CoV in Specimen K despite the 
fact that confirmatory NAT assays against targets other than upE were negative. 
Additionally, a small number of laboratories were found to be only performing an average of 
one PCR assay per sample. These results highlight the need for laboratories to follow a NAT 
regimen with at least two independent assays. Laboratories need to have detailed guidelines 
for MERS-CoV PCR test interpretation as well as reporting instructions. By addressing these 
issues, it is anticipated that the global laboratory capacity for MERS-CoV detection will be 
enhanced. 


Engaging international laboratories, especially those in countries with limited exposure to 
routine quality assurance proved to be one of the major challenges in organising and 
executing this PTP. Language barriers, limited resources, scepticism towards an unknown 
organisation, as well as the need for laboratories to continue their routine testing alongside 
PTP sample testing most likely contributed to difficulties with engagement. Jurisdictional 
difficulties with specimen handling were also an administrative challenge. Despite the 
material not being infectious, several laboratories required a range of documentation such as 
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import permits. Obtaining these documents was often time-consuming, and in more than one 
instance required eight weeks or longer before specimens could be received. The responses 
to these challenges need to include early engagement with laboratories, as much local 
interaction as possible with regional WHO support, and effective communication with 
customs and courier officials in order to avoid delays at the dispatch stage of the PTP. The 
strong support from the WHO regional offices was key to successfully running the PTP in 
96 laboratories from 79 countries. Contracting three different courier services ensured 
efficient distribution of the PTP globally, with 85% of laboratories receiving the panel 
within five days of dispatch. 


In conclusion, participating laboratories had a high overall capacity to detect MERS-CoV. 
The PTP identified improvement opportunities at a technical level, including i) the need for 
performance of confirmatory NAT assays, ii) avoidance of cross-contamination of samples, 
and 111) care with clear identification of the particular coronavirus target and result. 
Laboratories need access to QA programs, and continued encouragement for engaging in 
these QA activities, which are in addition to, but important for their diagnostic functions. 
Facilitating involvement of laboratories in appropriate QA programs is essential to 
continuing accurate detection of pathogens. Accurate diagnosis is critical where a pathogen 
is infrequently seen, and detection may have significant community, public health and social 
implications. Continuing involvement in well-regulated QA programs, attention to technical 
details, and staff development can avoid significant laboratory error and unnecessary public 
health concern. 
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Figure 1. Participant performance in the nine scored specimens for MERS-CoV 


Participants (%) 
uw 
So 


1 2 3 4 5 6 7 8 9 
Correct Responses (n) 


Figure 2. Average number of PCR assays performed per specimen, per laboratory 
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Table 1. Invitation and participation of laboratories worldwide 


A t Recei Report 
Invited Responded et . eccived epoted 
participate samples results 
WHO Region 
La  Countr La  Countr Countrie Lab Countri La  Countr 
; . Labs : 
bs ies bs ies S es bs ies 
African Region 13.13 7 7 7 7 7 7 6 6 
EASE MCAD» i. 19 16 1815 1815 17 14 
Region 
European Region 63 40 45 33 45 33 45 33 45 33 
Region of the Americas 9 9 6 6 6 6 5 B) P 5 
South-East Asia A 4 4 4 4 4 4 A 4 4 
Region 
Wester Pacific Region 21 15 21 15 19 14 19 «14 19 14 
Total 133 98 102 81 99 79 98 78 96 76 
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Table 2. Participant performance in PT panel 


No. (%) of participants (n=96) correctly reporting 


Number of correct results 


MERS-CoV detection 


9 76 (79.2) 
8 10 (10.4) 
7 GS) 
6 2 (2.1) 
5 0 (0.0) 
4 0 (0.0) 
3 1 (1.0) 
2 0 (0.0) 
1 0 (0.0) 
0 0 (0.0) 


Other HCoV detection 


Oe) 


15 (15.6) 


ON) 


20) 


1 (1.0) 


4 (4.2) 


8 (8.3) 


6 (6.3) 


4 (4.2) 


27 (28.1) 


Other HCoV 
identification 


N/A 


29 (30.2) 


26 (27.1) 


4 (4.2) 


37 (38.5) 
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Table 3. Specimen characteristics and performance of participants 


Genome 


No. (%) of participants (n=96) with 


Specimen Virus : , Other HCoV = Other 
equivalents/uL* MERS- Other Other meee HCov ID 
CoV HCoV HCoV not eat 
correct correct specified specitied 
UY 
ay MERS- 5 94 
g A CoV 4.3 x 10 (97.9) 47 (49.0) 48(50.0) N/A N/A 
E 
Es 
5 
HCoV- 2 90 
B 0C43 1.8 x 10 (93.8) 60 (62.5) 27(28.1) 55 (57.3) 41 (42.7) 
HCoV- 2 87 
Cc 220K 1.6x 10 (90.6) 61 (66.7) 27(28.1) 55 (57.3) 41 (42.7) 
MERS- 4.3x 10° 
CoV & 95 
H HCoV- 1.6 x 10° (99.0) 37 (38.5) 46(47.9) 33 (34.4) 63 (65.6) 
229E 
I Negative - a 1) 63 (65.6) 33(34.4) N/A N/A 
g 
2. MERS- 3 94 
zt E CoV 4.3 x 10 (97.9) 45 (46.9) 49(51.0) N/A N/A 
= 
MERS- > 94 
D Cov 43x 10 (97.9) 44 (45.8) 51(53.1) N/A N/A 
MERS- 1 94 
F CoV 4.3x 10 (97.9) 46 (47.9) 50(52.1) N/A N/A 
MERS- 0 92 
G Cov 43x10 (95.8) 47 (49.0) 49(51.0) N/A N/A 
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upE 43x 10° 


ORFla 46x 10° 


suoumtoads o1a4}UAS 


J ORFIb 16x10? an 7(73)  8(83) 3.1) 47 (49.0) 
RdRp 2.5x 10° 
N ND? 

K upE 43x 10° re 28 (29.2) 19(19.8) 3(3.1) 54 (56.3) 


* Genome equivalents after reconstitution of lyophilised specimens in 500 wL; ° ND — not 
determined 


Table 4. Target genes used by participants for MERS-CoV detection 


No. of participants (n=96) testing for a MERS-CoV specific target in each specimen* 
Target 
A B C D E F G H I J K Mean SD % 


upE wah uh Ge BC BB ODS 0.90 97.2 


orfla 49 45 46 49 49 49 49 49 46 51 53 48.6 2.29 50.7 


orflb 32.31 SOC” ee en ee en nr Om 127 33.6 


N 21 20 «21 21 21 21 21 21 19 22 32 21.8 3.46 22.7 


NCV.N2 20 20 19 18 20 19 19 19 19 19 19 19.2 0.60 20.0 


NCV.N3 19 13 12, 22 19 19 19 19 12 19 18 17.4 3.38 18.1 


RdRp 9 12 10 9 10 10 10 9 9 10 16 10.4 2.06 10.8 


* Assays include RT-PCR, conventional PCR and sequencing assays for N and RdRp 
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